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Abstract 


In collections of related time series data, several component series are often added 
together to produce a total series. Seasonal adjustment at the total level may be done 
by directly adjusting the total series. An alternative is to directly seasonally adjust the 

component series and obtain an estimate of the adjusted total by adding together the 
adjusted components. The latter approach is often described as an aggregative 
adjustment. A direct and an aggregative seasonal adjustment of the total series will 
generally produce non-identical results. This paper describes various diagnostic 

measures which can be used to help determine which approach gives the best results 

for particular series. 


Keywords: Seasonal adjustment, aggregation 


1 Introduction 


When a collection of series is to be seasonally adjusted for the first time or when 
additional series are to be added to an existing collection, a decision must be made on 
the most appropriate level at which to perform the seasonal adjustment of component 
series. Often there is a degree of flexibility in selecting the level of aggregation, and 
there are various factors that need to be taken into account when deciding on the best 
level for adjustment purposes. User demand for seasonally adjusted estimates of 
particular components is one important consideration. It is also important to 
determine whether the proposed adjustments will be of a sufficient quality. 


Many times when a set of time series requires seasonal adjustment, the set will 
include subtotal and total series consisting of the sums of other series. These series 
can either be directly seasonally adjusted in their own right, or alternatively 
seasonally adjusted estimates can be found by adding up the seasonally adjusted 
components. The first method is called a direct adjustment and the second method is 
called an aggregative adjustment. The purpose of this working paper is to discuss 
various diagnostic measures that can be used to quantify different aspects of seasonal 
adjustment quality in the context of examining the relative merits of direct versus 
aggregative seasonal adjustments for particular series. 


2 Why direct and aggregative adjustments produce 
different estimates 


Directly adjusting a set of component series and then adding the seasonally adjusted 
estimates to form an aggregative total can result in a somewhat different seasonally 
adjusted estimate at the total level than a direct adjustment at the total level would 
produce. This can occur if the individual components have widely differing seasonal 
patterns and as a result of nonlinearities in the seasonal adjustment process arising 
from the modification for extremes and multiplicative manipulations. 


The modification for extremes algorithm which forms part of the X11 seasonal 
adjustment process is the main contributor to the differences which occur. Sometimes 
the seasonal-irregular value for a given month in a particular year is an outlier or 
‘extreme’ observation which takes on a very different value from other values in that 
month. If such values are processed without being modified in some way, a seriously 
distorted estimate of the seasonality for that month can result. To avoid this, 
seasonal-irregulars that are identified as extreme are replaced with a weighted 
average of nearby values which are regarded as being more typical. Extreme 
seasonal-irregular values of opposite sign in component series can cancel each other 
out when added together, leading to a different interpretation of which values are to 
be treated as extreme at the more aggregated level. 


Another possible source of discrepancies arises from the parameter settings that are 
employed for the adjustment of the different series. Such parameter settings include 
the choice of which seasonal and trend moving averages are to be used, and the 
settings are normally chosen separately for each series so as to optimise the 
individual adjustments. It can easily happen that various component series use 
different parameter settings for their adjustment. 


For example, if two component series are individually seasonally adjusted, one 
component may be adjusted using a 3*5 seasonal moving average while the other 
component is adjusted using a 3*9 seasonal moving average. If the two components 
are added together to form a total and then seasonally adjusted, whichever seasonal 
moving average is used on the total must differ from the seasonal moving average 
applied to at least one of the components. The settings chosen for other adjustment 
parameters such as the trend moving average can cause similar problems. 


3 Some issues to consider when choosing between 
direct or aggregative adjustments 


It is preferable to avoid producing a set of seasonally adjusted estimates that are 
inconsistent with each other. If seasonally adjusted estimates of the component series 
are definitely required then the total series is often obtained by aggregation to ensure 
consistency. An exception to this practice is the seasonal adjustment of Retail Trade 
series where the Australia Total and various component series are all directly 
adjusted. A forcing procedure is used to distribute the discrepancy between the direct 
and aggegative adjustments across the components in a pro-rata fashion. However the 
forcing process introduces an additional degree of complexity into the periodic 
updating of seasonally adjusted estimates as additional data becomes available and so 
is not widely used. 


Often however the quality of adjustment of higher level subtotal and total series 
assumes paramount importance and the quality of estimates at finer levels of 
disaggregation is a secondary consideration. For example, in many collections 
interest centers on the 'headline' Australia Total series, with a smaller interest in 
State Totals, and less again on finer level splits within States. 


The quality of the adjustments tends to decline as the series are broken down into 
finer level components, and if the seasonal adjustment of disaggregated splits is 
attempted at too low a level the results may be so unreliable as to be of little use. The 
reason for this is that the seasonal pattern which is estimated and then removed by 
the seasonal adjustment process may be regarded as a signal which is mixed with an 
irregular or noise element. The noise element consists of a series of random 
fluctuations which have a tendency to cancel to a degree when component series are 
added together. More aggregated series usually have a better signal-to-noise 
characteristic than the contributing component series, which enables a more accurate 
estimate of the seasonality to be made. 


When deciding on which seasonal adjustment method to use, it is useful to have a set 
of tests or measures that can be used to compare the adjustment quality of 
aggregative versus direct adjustment for particular series. Tests developed by various 
time series researchers and reported in the literature focus on three different aspects 
of seasonal adjustment quality. These aspects are: 


1) tests for residual seasonality 

2) smoothness measures, and 

3) measures of adjustment stability. 

The purpose of seasonal adjustment is to remove the seasonal variation from the 
seasonally adjusted series. If there is still some seasonal pattern remaining in the 
seasonally adjusted series then this is evidence of a poor quality adjustment. 

If an aggregative adjustment of a series displays residual seasonality but a direct 


adjustment does not, then there are grounds for preferring the direct adjustment over 
the aggregative adjustment. Similarly if a direct adjustment displays residual 
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seasonality and an aggregative adjustment does not then the direct adjustment would 
be considered to be superior. If neither the direct nor the aggregative adjustment 
displays residual seasonality then both adjustments would be considered satisfactory 
with regard to the residual seasonality criterion. In the unfortunate circumstance that 
both the aggregative and direct adjustments display residual seasonality then the 
method with the smaller amount of residual seasonality would be considered the 
better method. 


Smoothness measures are based on the premise that users do not like large 
period-to-period movements in the seasonally adjusted series as it makes the data 
more difficult to interpret, so the smoother the seasonally adjusted series the better. If 
an aggregative adjustment produces a smoother seasonally adjusted series than the 
corresponding direct adjustment then, all other things being equal, the aggregative 
adjustment would be considered superior. If the direct adjustment gives a smoother 
result then this favours the use of direct adjustment. 


Measures of adjustment stability are an attempt to quantify the problem of revisions. 
Seasonally adjusted estimates that undergo large revisions when they are recalculated 
as additional time series values become available may cause users to lose confidence 
in the usefulness of the adjusted data. If the size of revisions is generally smaller for 
an aggregative adjustment than for a direct adjustment then the aggregative 
adjustment is preferred, if the size of revisions is smaller for a direct adjustment then 
the direct adjustment is preferred. 


Diagnostic measures of the three aspects of seasonal adjustment quality are discussed 
in more detail in the following sections. 


4 Residual seasonality 


Direct and aggregative adjustments of the same original data will, in general, produce 
non-identical seasonally adjusted series. This implies that somewhat different 
seasonal cycles in the original data have been identified and removed. If not all of the 
seasonal cycles are removed by the process of seasonal adjustment then the 
seasonally adjusted series will contain residual seasonality. The presence of residual 
seasonality is evidence of a poor quality adjustment. 


In the case of direct adjustments there are tests for residual seasonality (printed at the 
foot of the D11 table in X11) which are intended to guard against residual seasonality 
in the seasonally adjusted series. Given that an aggregatively adjusted series contains 
some different cycles from the direct adjustment, the aggregatively adjusted series 
should also be tested for the presence of residual seasonality. There are three 
different approaches to testing for residual seasonality that will be discussed further. 
These are the use of F tests, spectral methods, and readjusting seasonally adjusted 
series to detect residual seasonality. 


4.1 F tests 


The X11 seasonal adjustment program includes various F tests which are used to test 
for the presence of stable seasonality (tables B1 and D8), moving seasonality (table 
D8), and residual seasonality (table D11). All of these tests could potentially be used 
to test for residual seasonality in an aggregative seasonally adjusted series. In the 
normal use of X11 the tests (except for the test in table D11) are designed to test 
whether there is enough seasonality in the original series for it to be worthwhile 
carrying out an adjustment. If the input series is a seasonally adjusted series then the 
F tests provide an indication whether there is any remaining seasonality left in the 
input adjusted series. 


The existing tests for residual seasonality in X11 (at table D11) were originally added 
by Statistics Canada in their X11-ARIMA version of X11. They check for residual 
seasonality over the entire series and over the last 3 years of the data span. Dagum 
(1980') outlined that the tests are applied to the seasonally adjusted series from which 
the trend has been removed by first-order differencing at lag 3 for monthly series and 
lag 1 for quarterly series. For series that display a multiplicative relationship between 
the trend and residual-irregular elements, first-order differencing would result in the 
tests being applied to a residual-irregular series with non-stationary variance. A more 
appropriate procedure might be to divide the seasonally adjusted series by the trend 
to produce a multiplicative residual-irregular series with near constant variance. 
Unfortunately a copy of Higginson (1976’) which may shed more light on the reasons 
for the procedure adopted in X11-ARIMA could not be located. 


Once having obtained a residual-irregular series, comprehensive testing for residual 
seasonality would involve statistical tests for the presence of both moving and stable 
seasonality, possibly over a shorter subspan of data as well as over the entire series. 
In the subspan case using fewer data points would reduce the power of the tests. 


The reason that both stable and moving seasonality should be tested for is that an F 
test designed only to test for stable seasonality may easily fail to detect the presence 
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of seasonality if the seasonality present is moving. An F test designed to test for 
moving seasonality involves a two-way analysis of variance testing for differences 
between years and differences between months or quarters. An F test for stable 
seasonality is a one-way analysis of variance testing for differences between months 
or quarters only. 


The two-way analysis of variance test must allow for the fact that seasonal factors are 
adjusted to sum to approximately 12 (monthly) or 4 (quarterly) over any 12 month 
span. Unless this constraint is broken the test for differences between years will 
always turn out to be non-significant. The problem is solved by taking the absolute 
values of the mean corrected seasonal-irregular values. The one-way analysis of 
variance is not constrained and is based on a different procedure. This means that the 
F test for stable seasonality would be more sensitive than the test for moving 
seasonality. Appendix | contains details of F tests for stable and moving seasonality, 
or see Higginson (1975? & 1976*) and Shiskin et al (1967°, appendix A) for further 
details of the tests. 


4.2 Spectral analysis 


The latest version of the seasonal adjustment program developed by the U.S. Bureau 
of the Census, X-12-ARIMA, includes two spectral estimation routines. It is 
envisaged that spectral estimation will be included as a future enhancement to the 
ABS seasonal adjustment program, which is called Seasabs. There are various 
different methods that can be used to estimate the spectrum of a series. The two 
methods employed in X-12-ARIMA are the periodogram and an autoregressive 
spectrum estimator. 


It has been pointed out by authors such as Chatfield (1980° p137, 2nd ed) that the 
periodogram is not a consistent estimator of the spectrum although it is still a useful 
diagnostic tool. Consistent spectral estimation procedures include smoothing the 
periodogram, using a spectrum estimator involving a truncation and weighting 
procedure such as the Tukey or Parzen lag windows, autoregressive spectrum 
estimation techniques or more recently methods based on time-averaged wavelet 
analysis have been suggested. 


Checking for residual seasonality using a spectral plot consists of estimating the 
spectrum of the seasonally adjusted series and analysing the plot to see whether there 
are peaks in the spectrum at seasonal frequencies. The X-12-ARIMA program has a 
facility that automatically flags series which display possible spectral peaks at 
seasonal and/or trading day frequencies. The facility is described by Findlay et al 
(1998’): 


"Whenever seasonal adjustment is done (with or without trading day adjustment), 
X-12-ARIMA automatically estimates two spectra, (1) the spectrum of the 
month-to-month differences of the adjusted series modified for extreme values from 
X-11 output table E2 (or of the first differences of logarithms of this series with a 
multiplicative adjustment) and (2) the spectrum of the final irregular component 
adjusted for extreme values, from output table E3. First differencing is a crude 
detrending procedure that is usually adequate to enable the spectrum estimate to 
reveal significant seasonal and trading-day effects. The program compares the 
spectral amplitude at the seasonal and trading day frequencies .... with the amplitudes 


7 


at the next lower and higher frequencies plotted. If these neighbouring amplitudes are 
smaller by a margin that depends on the range of all spectrum amplitudes, then plots 
of the estimated spectra are automatically printed, together with a warning message 
that gives the number of "visually significant" peaks found at seasonal or trading day 
frequencies.’ 


Using the spectrum to check for residual seasonality may not be an especially 
powerful technique compared with some of the alternative methods. There are 
several different seasonal frequencies to check (six seasonal frequencies for monthly 
series and two for quarterly) and the method essentially relies on the analyst's 
judgement as to what constitutes a significant peak in the spectrum rather than simply 
the chance effect of noise. 


4.3 Readjusting the seasonally adjusted series 


The third method of checking for residual seasonality, and the one which has been 
used most often in ABS practice to date, is to take an aggregative seasonally adjusted 
series as the input series and run it through Seasabs a second time. As part of the 
resulting attempted adjustment the F tests in X11 which check for stable, moving and 
identifiable seasonality are applied, and an 'SI' chart which shows the detrended input 
series grouped by month or quarter is produced. 


The expert system built into Seasabs can weigh up the various diagnostic outputs 
from X11 and produce an assessment as to whether significant seasonality is present 
in the input series. If the conclusion is that the series can be successfully seasonally 
adjusted, then by implication the input series must contain an identifiable seasonal 
element. If on the other hand the diagnosis is that the series should not be seasonally 
adjusted because seasonality is not present, then this can be taken as an indication 
that the input series does not contain significant residual seasonality. Since the expert 
system diagnosis relies on decision rules built into the program it gives a consistent 
measure that does not require the analyst to make judgements on a series-by-series 
basis. 


A further aid to detecting residual seasonality in a seasonally adjusted time series is 
the 'SI' chart, which shows the clustering of detrended input values in relation to the 
neutral line, grouped by month or quarter. An 'SI' chart with one or more groups 
clustered above or below the neutral line is evidence of residual seasonality. The 'SI' 
chart requires interpretation by the analyst and is therefore a subjective measure, 
however the results may be easier to interpret than a spectrum plot, particularly for 
time series analysts who are likely to have considerable experience in interpreting SI 
charts. 


5 Smoothness measures 


The use of numerical measures of the smoothness of the seasonally adjusted series as 
an indicator of adjustment quality is based on the premise that users don't like large 
period-to-period movements in seasonally adjusted data, so the smoother the 
seasonally adjusted series the better. 


It could be argued that the degree of smoothness is not really an appropriate indicator 
of seasonal adjustment quality since the purpose of seasonal adjustment is not to 
produce a smooth series as such. Rather the purpose is to remove seasonal variation 
from the original series, leaving a series that contains both trend and 
residual-irregular variation. Some critics (eg Nettheim 1965°) of the X11 seasonal 
adjustment process have claimed that the method is prone to over-adjustment: the 
removal of more variation at seasonal and near-seasonal frequencies than is 
warranted. If such criticisms are valid, then a smoother seasonally adjusted series 
could be the result of over-adjustment rather than a better quality adjustment. 


Those users who require a smooth series can use the trend estimate instead of the 
seasonally adjusted series. Commentary published by the ABS has for several years 
emphasised that for many purposes the trend estimate provides a better guide than the 
seasonally adjusted series. 


Despite ABS attempts to encourage a greater emphasis on trend estimates, the focus 
of media commentary continues to rest largely on seasonally adjusted data, often with 
an emphasis on the most recent movement in the seasonally adjusted series. ABS 
experience has shown that large period-to-period movements in seasonally adjusted 
series can prompt an excited reaction from the user community so from a practical 
perspective an adjustment that provides a relatively smooth seasonally adjusted series 
is desirable. 


5.1 R measures 


The X11-ARIMA program developed by Statistics Canada includes two measures 
intended to distinguish whether an aggregative or a direct seasonal adjustment gives 
superior results. The two measures, designated R; and R2 (Dagum 1980’, Chapter 2), 
measure the roughness, or lack of smoothness, of the seasonally adjusted series. The 
adjustment which gives smaller R measures is considered the better adjustment. 


Findlay et al (1990) noted that 'there are no theoretical models of seasonality whose 
ideal seasonal adjustment minimises a quantity estimated by R: or Ro. For this reason, 
the use of such measures to compare adjustments (smoother is better) is somewhat 
unsatisfactory '. 


Despite the lack of theoretical underpinning, the R measures provide a useful guide 
to the typical size of movements in the seasonally adjusted series. User preference for 
smaller period-to-period movements in the seasonally adjusted series can be 
accommodated by selecting either the direct or aggregative adjustment depending on 
which has the smaller R measures. 


The measures are described by Findlay et al (1990°) as follows: 


R, is the mean of squares of first differences of the seasonally adjusted series: 
N 
Ri =(N-1)' © (Ar - Avi)’ 
t=2 


R> is the mean of squares of additive residual-irregulars (seasonally adjusted minus 
trend): 
N 
R.=N"™ 2 (A, - H,)” 
aa 


where A, (t = 1, .. , N) is the seasonally adjusted series (direct or aggregative), Hi (t = 
1, .. , N) is the associated trend obtained by smoothing the seasonally adjusted series 
with Henderson trend weights, and N is the length of the series. 


The two R measures are similar to each other, but since the seasonally adjusted series 
consists of trend and residual-irregular components the Ri measure can be adversely 
affected if the series contains strong short-term trend cycles. In these circumstances it 
is preferable to use the R2 measure. 


In X11-ARIMA the direct and aggregative adjustments are compared using 
percentage difference values, defined as 


Aj = 100 * (Ro = R,seereeative) / Ro i= 1 or 2. 
so that negative values of A; or A: favour direct adjustment. 


5.2 Other measures 


There are various other similar measures that could plausibly be used to measure the 
roughness of the seasonally adjusted series such as the average absolute percentage 
change period-to-period in the seasonally adjusted series (AAPC(SA)), or the mean 
of squares of multiplicative residual-irregulars around 1.0 (MSI). Formally, these 
measures may be defined as: 


N 
AAPC(SA) = (N- 1)! E [100 * (Ay~ Aut) / Au 
t=2 
N 
MSI = N"E (1, - 1.0) 
t=1 
where I, = A; / H: 


These measures are open to criticism on the same theoretical grounds as the R; and 
R» measures, but may be more appropriate for multiplicative series than the R 
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measures since they weight the 'roughness' more evenly as the level of the series rises 
and falls over time. 
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6 Measures of adjustment stability 


It is an inevitable consequence of the seasonal adjustment process that seasonally 
adjusted estimates are revised as additional data becomes available, either annually in 
the case of forward factor adjustments or each month or quarter in the case of 
concurrent adjustments. Seasonally adjusted estimates that undergo large revisions 
when they are recalculated as future time series values become available may cause 
users to lose confidence in the usefulness of the adjusted data. 


It is desirable that the revisions to the seasonally adjusted estimates be as small as 
possible at each update, and that the estimates converge quickly to their final values 
rather than undergoing a sequence of revisions that continues for many years as 
subsequent data is incorporated into the analysis. Therefore it is useful to have 
numeric measures which quantify the extent of revisions. When comparing direct and 
aggregative adjustments these measures allow identification of the method which 
results in smaller revisions (ie more stable adjustments). 


6.1 Star measures 


One such numeric measure currently used within the ABS is the 'star measure’. The 
value of the star measure for directly multiplicatively adjusted series is equal to the 
average absolute percentage change period-to-period in the residual-irregular 
component, or AAPC(I). An empirical rule of thumb linking the value of the star 
measure to the expected degree of revision of the seasonally adjusted series states 
that 'generally, the average percentage revision (without regard to sign) for the most 
recent year, will be approximately one half of the series' star value. This degree of 
revision can be expected to fall gradually to about one fifth of the star value for years 
four or more earlier’. 


The empirical rule of thumb has been developed with reference to directly adjusted 
series and may provide a less accurate guide to the stability of aggregative 
adjustments. Further study is required in order to resolve this question. 


For directly adjusted series an estimate of the residual-irregular component is 
available from the D13 table of X11. This table is not available for aggregatively 
adjusted series since they are summed from component series rather than being 
adjusted using X11. An alternative estimate of the residual-irregular component that 
can be made for both direct and aggregative adjustments is to divide the seasonally 
adjusted series by the trend estimate to obtain a multiplicative residual-irregular 
series. 


This procedure may not work successfully for additive adjustments. If the trend series 
changes sign then division by zero, or by a quantity very close to zero, may occur. 
Star measures are not presently calculated for direct additive adjustments. Since the 
vast majority of time series adjusted by the ABS are adjusted multiplicatively, the 

star measure has proven to be a useful guide to adjustment stability in practice. 


6.2 Sliding spans 
Findlay et al (1998”) discuss two types of stability diagnostics that are included in the 
X-12-ARIMA program, namely sliding spans and revision histories. Sliding span 
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diagnostics are also discussed in more detail in Findlay et al (1990”). The sliding span 
diagnostics compare different outcomes obtained by running a seasonal adjustment 
on up to four overlapping subspans of the series. For each period that is common to 
at least two of the subspans, these diagnostics analyse the difference between the 
largest and smallest seasonal adjustment factors for that period obtained from the 
different spans. They also analyse the largest and smallest estimates of 
period-to-period changes in the seasonally adjusted series and calculate analogous 
trend measures. 


The length of span that is used depends on the seasonal filter used for direct 


adjustment: 

Seasonal filter Length of span 
a3 6 years 

2 ae 8 years 

6 ae, 11 years 


The following diagram illustrates four 8 year spans of a series starting in January 
1988 and ending in December 1998. January 1994 falls within all four spans so 
separate adjustment of each span will result in four candidate seasonal adjustment 
factors S(1)i94, S(2)1,94, S(3)1.94 and S(4)104 for this month. 


Y1,88 ----------------- Ist span 
. 1/88 to 12/95 


Y1,94 — S(1)is4 S(2)i.94 S(3)i94 SA)iv4 


S10 a 


Each month that falls within two or more of the spans will have at least two different 
estimated seasonal adjustment factors. The extent of differences between the seasonal 
adjustment factor estimates from different spans gives a measure of the adjustment 
stability. 


Let S(k), denote the seasonal adjustment factor from span k for month t. For each 
month that falls within two or more spans, calculate the maximum difference 
between the estimated seasonal adjustment factors: 


Si" = ( max S(k); - min S(k); )/ min S(k) 

Findlay suggests that the seasonal adjustment factor estimate is unreliable if S;"“ > 
0.03, ie if the difference between the highest and lowest value of the estimated 
seasonal adjustment factor is greater than 3 percent. In order to obtain a summary 
measure of the adjustment stability, the percentage of months with S;"" > 0.03 is then 
calculated, and designated S(%). The higher the value of S(%), the more unstable the 
seasonal adjustment is considered to be. 


This measure can be used to make comparisons between direct and aggregative 
adjustments, since implicit seasonal adjustment factors may be obtained for 
aggregative adjustments by dividing the original series by the corresponding 
seasonally adjusted series. However it would be necessary to carry out aggregative 
adjustments over different spans in order to calculate the implicit S(k), and this may 
cause some operational difficulties in practice. 


The use of sliding-span diagnostics is not confined to comparisons between direct 
and aggregative adjustments. Findlay describes other diagnostic measures such as the 
month-to-month and year-to-year percentage change in the adjusted value from span 
k for month t. These can test the quality of direct seasonal adjustments and the 
reliability of trading day estimates, and aid the selection of appropriate seasonal 
filters. 


6.3 Revisions histories 


The second type of stability diagnostic in X-12-ARIMA considers the revisions 
associated with continuous seasonal adjustment over a period of years, and is referred 
to as a revisions history. It is described (in 1998’) in the following terms: 'The basic 
revision calculated by the program is the difference between the earliest adjustment 
of a month's datum obtained when that month is the final month in the series and a 
later adjustment based on all future data available at the time of the diagnostic 
analysis. Similar revisions are obtained for month-to-month changes, trend estimates, 
and trend changes. Sets of these revisions, calculated over a consecutive set of time 
points within the series, are called revisions histories. 


‘Suppose a set of options has been chosen for the application of X-12-ARIMA to the 
unadjusted time series Y;, | < t < N. For any of these months t and any integer u in 

the interval tSu <N, let Aj denote the seasonally adjusted value for time t obtained 
with these options when only the data Y;, 1 <t <u, are used in their calculation (Yui, 
.... Yn are withheld). For given t, as u increases these adjustments converge to a final 
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adjusted value. When the 3 * m seasonal filter is used, convergence is is usually 
effectively reached in about 1 + m/ 2 years. The largest revisions tend to occur when 
u is the same calendar month as t, specifically u=t + 12, t + 24, ..... and the next to 
largest changes a month later, u=t+1,t+13,t+ 25, ..... (In the additive 
decomposition case, the largest weights in the seasonal adjustment filter combining 
all of the seasonal adjustment calculations are at lags 1, 12, 13, 24, 25, ....). 


'The adjustment Ay: obtained from data through time t is called the concurrent 
adjustment. It is usually the first adjustment obtained for month t. We call Ayn the 
most recent adjustment. In the case of a multiplicative decomposition, the revision 
from the concurrent to the most recent adjustment for month t is calculated by the 
program as a percentage of the concurrent adjustment, Ryvn* = 100 * ( Ayn - Aye) / Aut. 
For given No and N; with No < Ni, the sequence Ryx*, No < t S Ni, is called a revision 
history of the seasonal adjustments from time No to N;. We suggest that No be at least 
as large as the effective length of the seasonal filter used, 12 * (2 +m ). It should 
definitely be large enough for reliable estimation of any trading-day or holiday 
adjustments being performed. 


'Period-to-period percent changes, A” Awu = 100 * ( Aqua - Aciju) / Aci are often as 
important as the seasonal adjustments. X-12-ARIMA can produce revision histories 
for them: Ryy*”“ = A” Ayn - A” Ay, No St < Ni. The program also calculates the 
analogous quantities for final Henderson trends Ty and for their period-to-period 
percent changes A”T,,. These histories are denoted by Ryn’ and Ryn*”", No St < Ni. 


Prior to calculating a revisions history, the start and end points of the revisions 
history span (ie No and N;) must be determined. The recommendation given by 
Findlay is that No = 12 *(2+m), andN,=N - 12 * (1+ m/2 ). For example we 
may have a monthly series containing 11 years of data which starts in January 1988 
and ends in December 1998. If this series is adjusted using a 3 * 5 seasonal moving 
average then m= 5. There are 11 * 12 observations ie N = 132 , No= 12 *(2+5)= 
84 and N; = 132 - 12 *(1+5/2)=90. This corresponds to starting the revisions 
history span in December 1994 and ending it in June 1995. 


Then the sequence Ryn*, No < t < Ni, can be obtained by running seasonal 
adjustments with end dates ranging from No to N; and comparing the concurrent 
adjustments with the corresponding most recent adjustments (ie comparing initial to 
‘final’ estimates for each time point in the range No to Ni). 


As the example given illustrates, a considerable length of data may be required in 
order to carry out a revisions history if the start and end dates are set according to the 
recommendations given by Findlay et al. Let N;' be the number of observations back 
from the end of the series that the revisions history span ends (ie N;' = 12 * (1+ m/ 


2) ). 
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The minimum number of observations N for various choices of seasonal moving 
average 1S: 


Seasonal Monthly Quarterly 
moving average 
SMA m No | Ni N (minimum) | No Ni N (minimum) 
ac 3 60 30 90 20 10 30 
(7.5 years) (7.5 years) 

Sues 5 84 42 126 28 14 42 

(10.5 years) (10.5 years) 
ae 9 132 | 66 198 44 22, 66 

(16.5 years) (16.5 years) 


The minimum values given will only permit a revisions history for a single month or 
quarter. In order to be useful the revisions history span should cover several months 
or quarters which means that for practical purposes the minimum number of 
observations in a series would need to be somewhat higher than indicated in the 
table. 


Findlay considers both average absolute percent revisions and the number of extreme 
revisions over the revisions history span. A revision of greater than 4 percent from 
initial to final of the seasonally adjusted series is considered to be extreme, however 
this value is clearly somewhat arbitary and would need to be set with reference to the 
series in question. 


The Avg | Ryx*| and No. | Ryx*| > 4.0% measures could be used to compare 
aggregative and direct adjustments. A smaller value of each measure is indicative of 
a more stable adjustment. In practice the need to run aggregative adjustments over a 
range of different end dates may cause some operational difficulties in the current 
ABS environment. 
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¢ Combining the diagnostics 


In order to use the diagnostic measures as a basis for selecting a direct or an 
aggregative adjustment, the various measures need to be combined to give an overall 
picture of adjustment quality for each method. How this may best be accomplished is 
a topic for further research and no definitive recommendations are given here. What 
follows is a brief outline of one possible approach. 


A weighted combination of the various diagnostic measures could be used to 
generate an overall measure of adjustment quality. For example, if a test for the 
presence of residual stable seasonality is not significant at the 5% level then a weight 
(or score) of 0 might be appropriate. If the test is significant at 5% but not at 1% then 
a weight of say 5 might be given, if the test is significant at 1% a weight of 20 could 
be given and if the test is significant at 0.1% a weight of 100 might be given. 


Smoothness measures such as the Average Absolute Percentage Change 
period-to-period in the seasonally adjusted series (AAPC(SA)) are in fact measures 
of the extent to which the series is not smooth, so a smaller value of the statistic 
indicates a smoother series. A smoothness score could be derived by multiplying the 
smoothness measure by an appropriate coefficient. The coefficient would need to be 
chosen so that the characteristic of smoothness is given an appropriate degree of 
importance in the overall picture of adjustment quality. 


Revision measures could be handled in a similar way to the smoothness measures. 
Since smallness of the degree of revisions is sought, numeric measures of the average 
size of revisions could be multiplied by an appropriate coefficient to obtain a 
revisions score. The various scores could then be added together to obtain an overall 
score for the series, with a smaller score being indicative of a higher quality 
adjustment. 


If the overall adjustment quality for series iis denoted Q; and the various quality 
measures are denoted Mj; for the different measures 1 to m, then Q; would be 
calculated as 
m 
Qi =) X; * Mi; , using a suitably chosen set of coefficients Xj. 
j=l 


This suggestion is in the spirit of the existing quality statistic or 'Q stat' that is 
calculated by X11 as a numeric measure of overall adjustment quality but for direct 
adjustments only (the Q stat is a weighted sum of 11 individual quality measures). 


Overall quality measures of individual series do not on their own provide a complete 
picture of the overall adjustment quality of a collection of series. An additional 
consideration is that some of the series may be of more interest or importance to the 
majority of users than others. Typically it is the main aggregates that are of most 
interest, such as Australia and State Totals. The quality of adjustment of these series 
is of primary importance and an adjustment method that ensures a good outcome for 
the most important series at the expense of lower quality adjustments of less 
important series seems sensible. 


17 


This suggests the use of a weighting function which specifies the relative importance 
of each series in the collection. The construction of such a weighting function would 
involve a degree of political sensitivity as a trade-off between the competing needs of 
different groups of users would be involved. For example, a weighting function that 
places a lot of importance on Australia level employment estimates and relatively 
little on employment estimates for the Northern Territory may be reasonable in some 
sense given that the Northern Territory is one of the smaller territories. The Northern 
Territory government might however be less than impressed with such a scheme. 


Assuming that a set of weights W; can be selected which reflect the relative 
importance of each series in a collection, a global quality measure Q, can be 
calculated by appropriately weighting the combined quality measure for each series 
and summing over all series. If there are n series in the collection then 


n 
Q,=L Wi* Qi. 
i=l 


Finding the best method of adjustment for the collection as a whole would then 
require systematically calculating Q, for each possible combination of aggregative 
and direct adjustments, and selecting the adjustment which minimises the global 
measure (since a smaller score is indicative of a higher quality adjustment). 
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8 Seasabs enhancements 


At the time of writing additional functionality is being added to Seasabs as part of an 
ongoing development program. The additional functionality is primarily intended to 
facilitate the introduction of concurrent seasonal adjustment to one or more 
additional ABS collections, but some of the new diagnostics are also applicable to 
the selection of aggregative or direct seasonal adjustments. In addition, other 
diagnostic measures intended for comparing aggrgative and direct adjustments are 
being incorporated. As a result of the current round of enhancements it is expected 
that in future Seasabs will include the following functionality: 


1) F test for residual stable seasonality 


See Appendix 1 for details of the test. 


2) F test for residual moving seasonality 
See Appendix 1 for details of the test. 


3) Ri 
R, is the mean of squares of first differences of the seasonally adjusted series: 
N 
Ri =(N-1)' © (A - Avi)’ 
t=2 


where A, (t = 1, .., N) is the publication seasonally adjusted series and N is the length 
of the series. 


4) Ro 


R2 is the mean of squares of additive residual-irregulars (seasonally adjusted minus 
trend): 
N 
R.=N"' 2 (A,- H)’ 
aa 


where A; (t= 1, .. , N) is the publication seasonally adjusted series , H; (t= 1, .. , N) is 
the publication trend series and N is the length of the series. Note that this measure is 
calculated the same way for both multiplicative and additive adjustments. 


5) AAPC(S.A.) or AAC(S.A.) 
For multiplicative adjustments the average absolute percentage change 
period-to-period in the publication seasonally adjusted series, for additive 


adjustments the average absolute change period-to-period in the publication 
seasonally adjusted series. 
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N 
AAPC(SA) = (N - Ly! E|100 * (Ay Aci) / Aci 
t=2 


N 
AAC(SA) = (N- 1)" £ |(Ac- Aci) 
t=2 
where A, (t = 1, .. , N) is the publication seasonally adjusted series and N is the length 
of the series. 
6) MSI 
Mean of squares of irregular series. 
Calculate an irregular series by dividing the publication seasonally adjusted series by 
the publication trend (multiplicative adj.) or by subtracting the publication trend from 
the publication seasonally adjusted (additive adj.). In the case of multiplicative series 
subtract 1.0 from the irregulars. 
Multiplicative: 
N 

MSI=N"* (I, - 1.0)” 

tet 
where I, = Ai / Hi 
Additive: 

N 
MSI=N'EXI? 


t=1 


where I, = A; - Hi 


7) STAR measures 


For multiplicative adjustments the average absolute percentage change 
period-to-period in the multiplicative irregular series, for additive adjustments the 
average absolute change period-to-period in the additive irregular series. 


Calculate an irregular series by dividing the publication seasonally adjusted series by 


the publication trend (multiplicative adj.) or by subtracting the publication trend from 
the publication seasonally adjusted (additive adj.). 
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Multiplicative: 


N 
STAR = AAPC(I) = (N - 1)! £ {100 * (Le - Tea) / Teal 
t=2 
where I, = A, / Hi 
Additive: 
N 
STAR = AAC()) = (N- 1)? £ |(L- Le) 
t=2 


where I; = A; - Hi 


8) Average absolute percent revision in the seasonally adjusted series 


Calculate for both direct and aggregate adjustments. User specifies No and Ni, the 
start and end dates of the simulation span. 


Calculate Run’ = 100 * ( Att = Aun ) / Aun for No < t < N, 

Calculate Avg | Ryy*| 

9) Average absolute percent revision in the period-to-period movements of the 
seasonally adjusted series 


Calculate for both direct and aggregate adjustments. User specifies No and Ni, the 
start and end dates of the simulation span. 


Calculate Ryn” = A” Ayn - A” Ay =~ for No St $< Ni, 
where A” Agu = 100 * ( Atu- Aci) / Acie 


Calculate Avg | Ryn” 
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9 Summary tables 


To conclude this report a summary of the tests and measures for comparing direct 
and aggregative adjustments that have been discussed is presented in tabular form. In 
some cases the measures have other uses which may help to justify their inclusion in 


Seasabs. These other potential uses are indicated. 


9.1 Residual seasonality 


Test Operation of test Other uses of test 
F tests 

Test for moving 1) Calculate aggregative irregular 

seasonality series 


IL = A/H fort=1toN 


2) Apply F test as set out in Appendix 
1 
3) If moving seasonality is present the 


aggregative adjustment is 
unsatisfactory 


Test for stable seasonality 


1) Calculate aggregative irregular 
series 
I = A: / Hi fort=1toN 


2) Apply F test as set out in Appendix 
1 
3) If stable seasonality is present the 


aggregative adjustment is 
unsatisfactory 


Spectral analysis 


Estimate spectrum of 
seasonally adjusted series 


1) Examine spectrum of aggregative 
seasonally adjusted series for peaks at 
seasonal frequencies 


2) If seasonal peaks are present the 
aggregative adjustment is 
unsatisfactory 


Can be used to investigate 
the impact of trading day 
variation, moving 
holidays, the business 
cycle and other cyclical 
phenomena in a series. It 
allows examination of the 
results of different 
filtering operations, and 
can provide information 
on the characteristics of 
the irregular component. 


Readjust seasonally 
adjusted series 


Expert system diagnosis 


1) Save aggregative seasonally 
adjusted series to a file 


2) Seasonally adjust 
3) If the adjustment is rated successful 


the aggregative adjustment is 
unsatisfactory 
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SI charts 


1) Save aggregative seasonally 
adjusted series to a file 


2) Seasonally adjust 


3) Examine SI charts for evidence of 
high or low months/quarters 


4) If there are high or low 
months/quarters the aggregative 
adjustment is unsatisfactory 
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9.2 Smoothness measures 


Test 


Operation of test 


Other uses of 
test 


R measures 


R1 


1) Calculate 


for both aggregative and direct 
adjustments 


2) The adjustment with the lower 
value of R; is rated the better 
adjustment 


1) Calculate 
N 
R, = N! X= (A, - HY’ 
t=1 


for both aggregative and direct 
adjustments 


2) The adjustment with the lower 
value of R2 is rated the better 
adjustment 


Other measures 


Average absolute percentage 
change period-to-period in the 
seasonally adjusted series 


1) Calculate 
AAPC(SA) = (N- 1)! * 
N 


2 |100 * (Ar - Aci) / Acil 
t=2 


for both aggregative and direct 
adjustments 


2) The adjustment with the lower 
value of AAPC(SA) is rated the better 


adjustment 
Mean of squares of multiplicative | 1) Calculate 
irregulars around 1.0 N 
MSI = N'Y (I,- 1.0)? 
t=1 


where I, = A, / Hi 


for both aggregative and direct 
adjustments 


2) The adjustment with the lower 
value of MSI is rated the better 
adjustment 
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9.3 Measures of adjustment stability 


Test 


Operation of test 


Other uses of 
test 


Star measure 


Average absolute percentage 
change period-to-period in the 
irregular series 


1) Calculate 
AAPC(I) = (N-1)!* 
N 
X|100 * (i - Lees) / Te 
t=2 


where I, = A, / Hi 


for both aggregative and direct 
adjustments 


2) The adjustment with the lower 
value of AAPC(D is rated the better 
adjustment 


Sliding spans 


Percentage of periods that fall 
within at least two spans where 
the difference between the largest 
and smallest seasonal adjustment 
factor is more than 3% 


1) Calculate 

Sm = 

(max S(k),- min S(k),) / min S(k), 
for span k and time t where t falls 
within at least 2 spans 


2) Calculate 
S(%) = percentage of 
Sim > 0.03 


Perform steps 1) and 2) for both 
aggregative and direct adjustments 


3) The adjustment with the lower 
value of S(%) is rated the better 
adjustment 


Can be used to 
test whether 
seasonal 
adjustment should 
be performed on a 
truncated data 
span because the 
adjustment in the 
earlier years is 
unreliable 


Can be used as an 
aid in choosing 
the appropriate 
seasonal moving 
average to use for 
direct adjustments 


Percentage of periods that fall 
within at least two spans where 
the difference between the largest 
and smallest period-to-period 
movement in the seasonally 
adjusted series is more than 3% 


1) Calculate 

M(k), = 

(Ak): - ACK) / A(k)e1 

for span k and time t where t and t-1 
fall within at least 2 spans 


2) Calculate 
M;™* = 
(max M(k), - min M(k),) / min M(k), 


3) Calculate 
M(%) = percentage of 
M,™* > 0.03 


Perform steps 1), 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 
value of M(%) is rated the better 
adjustment 


Can be used as an 
aid in choosing 
the appropriate 
seasonal moving 
average to use for 
direct adjustments 
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Percentage of periods that fall 
within at least two spans where 
the difference between the largest 
and smallest year-to-year 
movement in the seasonally 
adjusted series is more than 3% 


1) Calculate 

Y(k) = 

(A(k).- Ad) 12) / Adder 

for span k and time t where t and t-12 
fall within at least 2 spans 


2) Calculate 
¥ue = 
(max Y(k), - min Y(k),) / min Y(k), 


3) Calculate 
Y(%) = percentage of 
Yi"™ > 0.03 


Perform steps 1), 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 
value of Y(%) is rated the better 
adjustment 


Can be used as an 
indicator that 
trading day 
estimates are 
unreliable 


Can be used as an 
aid in choosing 
the appropriate 
seasonal moving 
average to use for 
direct adjustments 


Revisions history 


Average absolute percent revision 
in the seasonally adjusted series 
over the history span 


1) Calculate 
No = 12* (2+ m), 
N, = N-12* (1 4+m/2) 


2) Calculate 
Ryn* = 100* (Ayn > Ait) / Au 
for No <t<N; 


3) Calculate 
Avg | Ruy* | 


Perform steps 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 
value of 

Avg | Ryv* | is rated the better 
adjustment 


The average size 
of revisions in the 
seasonally 
adjusted estimates 
from their initial 
to their final 
stable values may 
be of interest to 
users 


Number of extreme revisions of 
more than 4% in the seasonally 
adjusted series over the history 
span 


1) Calculate 
No = 12* (2+ m), 
N, = N-12* (1 4+m/2) 


2) Calculate 
Ryn“ = 100 * (Aun = Au / Attt 
for No <t<N; 


3) Calculate 
No. | Ryn* | > 4.0% 


Perform steps 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 
value of 

No. | Ryn“ | > 4.0% is rated the better 
adjustment 


26 


Average absolute percent revision 
in the period-to-period 
movements of the seasonally 
adjusted series over the history 
span 


1) Calculate 
No = 12* (2+ m), 
N, = N-12* (1 4+m/2) 


2) Calculate 

Ry” = A” Aun = A” An 
for No <t< N, 

where 

A” Adu = 

100 = (Agu = Acifu) / Acifu 


3) Calculate 
Avg | Ry** 


Perform steps 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 


value of 
Avg | Ry** 
adjustment 


is rated the better 


The average size 
of revisions of the 
movements in 
seasonally 
adjusted estimates 
from their initial 
to their final 
stable values may 
be of interest to 
users 


Number of extreme revisions of 
more than 4% in the 
period-to-period movements of 
the seasonally adjusted series 
over the history span 


1) Calculate 
No = 12* (2+ m), 
N, = N-12* (1 +m/2) 


2) Calculate 

RyA* = A” Aun = A” Au 
for No<t<Ni 

where 

A” Adu = 

100 * (Agu = Acifu) / Aciju 


3) Calculate 


No. | RywA®* | > 4.0% 


Perform steps 2) and 3) for both 
aggregative and direct adjustments 


4) The adjustment with the lower 


value of 
No. | RynA”* 
better adjustment 


> 4.0% is rated the 
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Appendix 1 


A two-way analysis of variance test for the presence of moving seasonality 


The following calculations are for monthly data. Calculations for quarterly data are 
very similar, the only difference is that in the quarterly case there are 4 periods per 
year rather than 12. 


Let SIi, be the multiplicative seasonal-irregular for year i and month j. To simplify the 
calculations, only consider complete calendar years. That is, discard the observations 
from partly-recorded years at the start or finish of the data span, so that iruns from | 
to L, the number of complete years of data. 


7 12 

Let Xi; = 1/12 X |SIj - 1.0| be the average of the absolute values of the 
jet 
mean-corrected seasonal-irregulars for each year, 
= L 
Xj; = 1/L& |SIj - 1.0] be the average of the absolute values of the 
iad 
mean-corrected seasonal-irregulars for each month, and 
= | ens 2 
X=1I1mzX © |SIj- 1.0], n= 12 * L be the average of the absolute values of 
ea) ea 


all of the mean-corrected seasonal-irregulars. 


Then total sum of squares 


L 12 = 
TSS=z » (\SI; - 1.0] - xy, 
i=1 j=l 


sum of squares due to years 


ieee, 
SSY 2127-2. (eX); 
i=l 


sum of squares due to months 
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SSM =L*¥ (X,-X)*, and 
j=l 


sum of squares of error 


SSE = TSS - SSY - SSM. 
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ANOVA Table 


Source Degrees of Sum of Mean 
Freedom squares squares 
Years L-1 SSY MSY = SSY/(L - 1) 
Months 11 SSM MSM = SSM/11 
Error n-L-12+1 SSE MSE = SSE/(n - L - 12 + 1) 
Total n- 1 TSS 


To test the null hypothesis that there is no difference between years, use the F 
statistic 


F = MSY/MSE, and reject if F > Fa based on v1 = (L - 1) and v2 =(n- L- 12 + 1) 
degrees of freedom. 


If F > Fa conclude that moving seasonality is present in the series, otherwise 
conclude that moving seasonality is not present. 


The null hypothesis that there is no difference between months could also be tested 
using the F statistic F = MSM/MSE. 

A one-way analysis of variance (without mean correction and without taking absolute 
values) may be more sensitive for testing for differences between months ie whether 
stable seasonality is present or not. 


A one-way analysis of variance test for the presence of stable seasonality 


The following calculations are for a test applied to monthly data. Calculations for 
quarterly data are very similar, the only difference is that in the quarterly case there 
are 4 periods per year rather than 12. 


Let SIi; be the multiplicative seasonal-irregular for year 1 and month Jj, and let n; , j = 
1,,12 be the number of observations in month j. 


je Nj 
Let X; = 1/n; X SIi; be the average of the seasonal-irregulars for each month, and 
i=l 
= Nj 12 12 
X=InxX 2X SI ,n= 2 n;,be the average of all of the irregulars. 
(le ek qe 


Then total sum of squares 
Nj 12 = 


TSS S2> -E. Shy Xy; 
erie 
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sum of squares due to months 
12 rs 
SSM=2 Nj = (X; = x), and 
i= 


sum of squares of error 


SSE = TSS - SSM. 


ANOVA Table 

Source Degrees of freedom Sum of squares Mean squares 
Months 11 SSM MSM = SSM/11 
Error n-12 SSE MSE = SSE/(n - 12) 
Total n-1 TSS 


To test the null hypothesis that there is no difference between months, use the F 
Statistic 


F =MSM/MSE, and reject if F > Fa based on v1 = 11 and v2 = (n - 12) degrees of 
freedom. 


If F > Fa conclude that stable seasonality is present in the series, otherwise conclude 
that stable seasonality is not present. 
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